Walsh Function
   HOME

TheInfoList



OR:

In
mathematics Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented in modern mathematics ...
, more specifically in
harmonic analysis Harmonic analysis is a branch of mathematics concerned with the representation of Function (mathematics), functions or signals as the Superposition principle, superposition of basic waves, and the study of and generalization of the notions of Fo ...
, Walsh functions form a complete orthogonal set of functions that can be used to represent any discrete function—just like
trigonometric function In mathematics, the trigonometric functions (also called circular functions, angle functions or goniometric functions) are real functions which relate an angle of a right-angled triangle to ratios of two side lengths. They are widely used in all ...
s can be used to represent any continuous function in
Fourier analysis In mathematics, Fourier analysis () is the study of the way general functions may be represented or approximated by sums of simpler trigonometric functions. Fourier analysis grew from the study of Fourier series, and is named after Josep ...
. They can thus be viewed as a discrete, digital counterpart of the continuous, analog system of trigonometric functions on the
unit interval In mathematics, the unit interval is the closed interval , that is, the set of all real numbers that are greater than or equal to 0 and less than or equal to 1. It is often denoted ' (capital letter ). In addition to its role in real analysis, ...
. But unlike the sine and cosine functions, which are
continuous Continuity or continuous may refer to: Mathematics * Continuity (mathematics), the opposing concept to discreteness; common examples include ** Continuous probability distribution or random variable in probability and statistics ** Continuous ...
, Walsh functions are piecewise constant. They take the values −1 and +1 only, on sub-intervals defined by dyadic fractions. The system of Walsh functions is known as the Walsh system. It is an extension of the
Rademacher system Rademacher is an occupational surname of German origin, which means "wheelmaker". It may refer to: People * Arthur Rademacher (1889–1981), Australian football player * Autumn Rademacher (born 1975), American basketball coach * Bill Rademacher (bo ...
of orthogonal functions. Walsh functions, the Walsh system, the Walsh series, and the
fast Walsh–Hadamard transform In computational mathematics, the Hadamard ordered fast Walsh–Hadamard transform (FWHT''h'') is an efficient algorithm to compute the Walsh–Hadamard transform (WHT). A naive implementation of the WHT of order n = 2^m would have a computati ...
are all named after the American
mathematician A mathematician is someone who uses an extensive knowledge of mathematics in their work, typically to solve mathematical problems. Mathematicians are concerned with numbers, data, quantity, structure, space, models, and change. History On ...
Joseph L. Walsh __NOTOC__ Joseph Leonard Walsh (September 21, 1895 – December 6, 1973) was an American mathematician who worked mainly in the field of analysis. The Walsh function and the Walsh–Hadamard code are named after him. The Grace–Walsh–Szegő ...
. They find various applications in physics and engineering when analyzing digital signals. Historically, various
numeration A numeral system (or system of numeration) is a writing system for expressing numbers; that is, a mathematical notation for representing numbers of a given set, using digits or other symbols in a consistent manner. The same sequence of symbo ...
s of Walsh functions have been used; none of them is particularly superior to another. This articles uses the ''Walsh–Paley numeration''.


Definition

We define the sequence of Walsh functions W_k: ,1\rightarrow \ , k \in \mathbb N as follows. For any natural number ''k'', and real number x \in ,1, let : k_j be the ''j''th bit in the binary representation of ''k'', starting with k_0 as the least significant bit, and : x_j be the ''j''th bit in the fractional binary representation of x, starting with x_1 as the most significant fractional bit. Then, by definition : W_k(x) = (-1)^ In particular, W_0(x)=1 everywhere on the interval, since all bits of ''k'' are zero. Notice that W_ is precisely the
Rademacher function In mathematics, the Haar wavelet is a sequence of rescaled "square-shaped" functions which together form a wavelet family or basis. Wavelet analysis is similar to Fourier analysis in that it allows a target function over an interval to be repres ...
''r''m. Thus, the Rademacher system is a subsystem of the Walsh system. Moreover, every Walsh function is a product of Rademacher functions: : W_k(x) = \prod_^\infty r_j(x)^


Comparison between Walsh functions and trigonometric functions

Walsh functions and trigonometric functions are both systems that form a complete,
orthonormal In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal (or perpendicular along a line) unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of un ...
set of functions, an
orthonormal basis In mathematics, particularly linear algebra, an orthonormal basis for an inner product space ''V'' with finite dimension is a basis for V whose vectors are orthonormal, that is, they are all unit vectors and orthogonal to each other. For example, ...
in
Hilbert space In mathematics, Hilbert spaces (named after David Hilbert) allow generalizing the methods of linear algebra and calculus from (finite-dimensional) Euclidean vector spaces to spaces that may be infinite-dimensional. Hilbert spaces arise natural ...
L^2 ,1 of the
square-integrable In mathematics, a square-integrable function, also called a quadratically integrable function or L^2 function or square-summable function, is a real number, real- or complex number, complex-valued measurable function for which the integral of the s ...
functions on the unit interval. Both are systems of bounded functions, unlike, say, the Haar system or the Franklin system. Both trigonometric and Walsh systems admit natural extension by periodicity from the unit interval to the real line \mathbb R . Furthermore, both
Fourier analysis In mathematics, Fourier analysis () is the study of the way general functions may be represented or approximated by sums of simpler trigonometric functions. Fourier analysis grew from the study of Fourier series, and is named after Josep ...
on the unit interval (
Fourier series A Fourier series () is a summation of harmonically related sinusoidal functions, also known as components or harmonics. The result of the summation is a periodic function whose functional form is determined by the choices of cycle length (or ''p ...
) and on the real line (
Fourier transform A Fourier transform (FT) is a mathematical transform that decomposes functions into frequency components, which are represented by the output of the transform as a function of frequency. Most commonly functions of time or space are transformed, ...
) have their digital counterparts defined via Walsh system, the Walsh series analogous to the Fourier series, and the
Hadamard transform The Hadamard transform (also known as the Walsh–Hadamard transform, Hadamard–Rademacher–Walsh transform, Walsh transform, or Walsh–Fourier transform) is an example of a generalized class of Fourier transforms. It performs an orthogonal ...
analogous to the Fourier transform.


Properties

The Walsh system \, k \in \mathbb N_0 is a commutative multiplicative discrete group isomorphic to \coprod_^\infty \mathbb Z / 2\mathbb Z , the
Pontryagin dual In mathematics, Pontryagin duality is a duality between locally compact abelian groups that allows generalizing Fourier transform to all such groups, which include the circle group (the multiplicative group of complex numbers of modulus one), ...
of Cantor group \prod_^\infty \mathbb Z / 2\mathbb Z . Its identity is W_0 , and every element is of order two (that is, self-inverse). The Walsh system is an
orthonormal In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal (or perpendicular along a line) unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of un ...
basis of Hilbert space L^2 ,1. Orthonormality means : \int_0^1 W_k(x)W_l(x)dx = \delta_ , and being a basis means that if, for every f \in L^2 ,1, we set f_k = \int_0^1 f(x)W_k(x)dx then : \int_0^1 ( f(x) - \sum_^N f_k W_k(x) )^2dx \xrightarrow \rightarrow\infty0 It turns out that for every f \in L^2 ,1, the series \sum_^\infty f_k W_k(x) converge to f(x) for almost every x \in ,1. The Walsh system (in Walsh-Paley numeration) forms a
Schauder basis In mathematics, a Schauder basis or countable basis is similar to the usual ( Hamel) basis of a vector space; the difference is that Hamel bases use linear combinations that are finite sums, while for Schauder bases they may be infinite sums. This ...
in L^p ,1,   1< p < \infty . Note that, unlike the Haar system, and like the trigonometric system, this basis is not unconditional, nor is the system a Schauder basis in L^1 ,1.


Generalizations


Walsh-Ferleger systems

Let \mathbb D = \prod_^\infty \mathbb Z / 2\mathbb Z be the compact Cantor group endowed with
Haar measure In mathematical analysis, the Haar measure assigns an "invariant volume" to subsets of locally compact topological groups, consequently defining an integral for functions on those groups. This measure was introduced by Alfréd Haar in 1933, though ...
and let \hat = \coprod_^\infty \mathbb Z / 2\mathbb Z be its discrete group of
characters Character or Characters may refer to: Arts, entertainment, and media Literature * ''Character'' (novel), a 1936 Dutch novel by Ferdinand Bordewijk * ''Characters'' (Theophrastus), a classical Greek set of character sketches attributed to The ...
. Elements of \hat are readily identified with Walsh functions. Of course, the characters are defined on \mathbb D while Walsh functions are defined on the unit interval, but since there exists a modulo zero isomorphism between these
measure space A measure space is a basic object of measure theory, a branch of mathematics that studies generalized notions of volumes. It contains an underlying set, the subsets of this set that are feasible for measuring (the -algebra) and the method that i ...
s, measurable functions on them are identified via
isometry In mathematics, an isometry (or congruence, or congruent transformation) is a distance-preserving transformation between metric spaces, usually assumed to be bijective. The word isometry is derived from the Ancient Greek: ἴσος ''isos'' mea ...
. Then basic
representation theory Representation theory is a branch of mathematics that studies abstract algebraic structures by ''representing'' their elements as linear transformations of vector spaces, and studies modules over these abstract algebraic structures. In essen ...
suggests the following broad generalization of the concept of Walsh system. For an arbitrary
Banach space In mathematics, more specifically in functional analysis, a Banach space (pronounced ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between vector ...
(X,, , \cdot, , ) let \_ \subset Aut(X) be a strongly continuous, uniformly bounded faithful action of \mathbb D on ''X''. For every \gamma \in \hat , consider its
eigenspace In linear algebra, an eigenvector () or characteristic vector of a linear transformation is a nonzero vector that changes at most by a scalar factor when that linear transformation is applied to it. The corresponding eigenvalue, often denoted b ...
X_\gamma = \ . Then ''X'' is the closed linear span of the eigenspaces: X = \overline(X_\gamma, \gamma \in \hat ) . Assume that every eigenspace is one-dimensional and pick an element w_\gamma \in X_\gamma such that , , w_\gamma, , =1 . Then the system \_ , or the same system in the Walsh-Paley numeration of the characters \_ is called generalized Walsh system associated with action \_ . Classical Walsh system becomes a special case, namely, for : R_t: x=\sum_^\infty x_j2^ \mapsto \sum_^\infty (x_j \oplus t_j)2^ where \oplus is addition modulo 2. In the early 1990s, Serge Ferleger and Fyodor Sukochev showed that in a broad class of Banach spaces (so called ''UMD'' spaces ) generalized Walsh systems have many properties similar to the classical one: they form a Schauder basis and a uniform finite dimensional decomposition in the space, have property of random unconditional convergence. One important example of generalized Walsh system is Fermion Walsh system in non-commutative ''L''p spaces associated with hyperfinite type II factor.


Fermion Walsh system

The
Fermion In particle physics, a fermion is a particle that follows Fermi–Dirac statistics. Generally, it has a half-odd-integer spin: spin , spin , etc. In addition, these particles obey the Pauli exclusion principle. Fermions include all quarks an ...
Walsh system is a non-commutative, or "quantum" analog of the classical Walsh system. Unlike the latter, it consists of operators, not functions. Nevertheless, both systems share many important properties, e.g., both form an orthonormal basis in corresponding Hilbert space, or
Schauder basis In mathematics, a Schauder basis or countable basis is similar to the usual ( Hamel) basis of a vector space; the difference is that Hamel bases use linear combinations that are finite sums, while for Schauder bases they may be infinite sums. This ...
in corresponding symmetric spaces. Elements of the Fermion Walsh system are called ''Walsh operators''. The term ''Fermion'' in the name of the system is explained by the fact that the enveloping operator space, the so-called hyperfinite type II factor \mathcal R, may be viewed as the space of ''observables'' of the system of countably infinite number of distinct spin \frac fermions. Each Rademacher operator acts on one particular fermion coordinate only, and there it is a
Pauli matrix In mathematical physics and mathematics, the Pauli matrices are a set of three complex matrices which are Hermitian, involutory and unitary. Usually indicated by the Greek letter sigma (), they are occasionally denoted by tau () when used in ...
. It may be identified with the observable measuring spin component of that fermion along one of the axes \ in spin space. Thus, a Walsh operator measures the spin of a subset of fermions, each along its own axis.


Vilenkin system

Fix a sequence \alpha = (\alpha_1,\alpha_2,...) of integers with \alpha_k \geq 2, k=1,2,\dots and let \mathbb G = \mathbb G_\alpha = \prod_^\infty \mathbb Z / \alpha_k\mathbb Z endowed with the
product topology In topology and related areas of mathematics, a product space is the Cartesian product of a family of topological spaces equipped with a natural topology called the product topology. This topology differs from another, perhaps more natural-seemin ...
and the normalized Haar measure. Define A_0 = 1 and A_k = \alpha_1 \alpha_2 \dots \alpha_ . Each x \in \mathbb G can be associated with the real number : \left, x\ = \sum_^ \frac \in \left ,1\right This correspondence is a module zero isomorphism between \mathbb G and the unit interval. It also defines a norm which generates the topology of \mathbb G . For k=1,2,\dots, let \rho_k: \mathbb G \to \mathbb C where : \rho_k(x) = \exp(i\frac) = \cos(\frac) + i \sin(\frac). The set \ is called ''generalized Rademacher system''. The Vilenkin system is the group \hat = \coprod_^\infty \mathbb Z / \alpha_k \mathbb Z of (complex-valued) characters of \mathbb G, which are all finite products of \. For each non-negative integer n there is a unique sequence n_0, n_1, \dots such that 0 \leq n_k < \alpha_, k=0,1,2,\dots and : n = \sum_^ n_k A_k. Then \hat = where : \chi_n = \sum_^ \rho_^. In particular, if \alpha_k = 2, k=1,2..., then \mathbb G is the Cantor group and \hat = \left\ is the (real-valued) Walsh-Paley system. The Vilenkin system is a complete orthonormal system on \mathbb G and forms a
Schauder basis In mathematics, a Schauder basis or countable basis is similar to the usual ( Hamel) basis of a vector space; the difference is that Hamel bases use linear combinations that are finite sums, while for Schauder bases they may be infinite sums. This ...
in L^p(\mathbb G, \mathbb C) ,   1 < p < \infty .


Binary Surfaces

Romanuke showed that Walsh functions can be generalized to binary surfaces in a particular case of function of two variables. There also exist eight Walsh-like bases of orthonormal binary functions, whose structure is nonregular (unlike the structure of Walsh functions). These eight bases are generalized to surfaces (in the case of the function of two variables) also. It was proved that piecewise-constant functions can be represented within each of nine bases (including the Walsh functions basis) as finite sums of binary functions, when weighted with proper coefficients.


Nonlinear Phase Extensions

Nonlinear phase extensions of discrete Walsh-
Hadamard transform The Hadamard transform (also known as the Walsh–Hadamard transform, Hadamard–Rademacher–Walsh transform, Walsh transform, or Walsh–Fourier transform) is an example of a generalized class of Fourier transforms. It performs an orthogonal ...
were developed. It was shown that the nonlinear phase basis functions with improved cross-correlation properties significantly outperform the traditional Walsh codes in code division multiple access (CDMA) communications.A.N. Akansu and R. Poluri,
"Walsh-Like Nonlinear Phase Orthogonal Codes for Direct Sequence CDMA Communications,"
IEEE Trans. Signal Process., vol. 55, no. 7, pp. 3800–3806, July 2007.


Applications

Applications of the Walsh functions can be found wherever digit representations are used, including
speech recognition Speech recognition is an interdisciplinary subfield of computer science and computational linguistics that develops methodologies and technologies that enable the recognition and translation of spoken language into text by computers with the m ...
, medical and biological
image processing An image is a visual representation of something. It can be two-dimensional, three-dimensional, or somehow otherwise feed into the visual system to convey information. An image can be an artifact, such as a photograph or other two-dimensiona ...
, and
digital holography Digital holography refers to the acquisition and processing of holograms with a digital sensor array, typically a CCD camera or a similar device. Image rendering, or reconstruction of object ''data'' is performed numerically from digitized interfero ...
. For example, the
fast Walsh–Hadamard transform In computational mathematics, the Hadamard ordered fast Walsh–Hadamard transform (FWHT''h'') is an efficient algorithm to compute the Walsh–Hadamard transform (WHT). A naive implementation of the WHT of order n = 2^m would have a computati ...
(FWHT) may be used in the analysis of digital
quasi-Monte Carlo method In numerical analysis, the quasi-Monte Carlo method is a method for numerical integration and solving some other problems using low-discrepancy sequences (also called quasi-random sequences or sub-random sequences). This is in contrast to the regu ...
s. In
radio astronomy Radio astronomy is a subfield of astronomy that studies celestial objects at radio frequencies. The first detection of radio waves from an astronomical object was in 1933, when Karl Jansky at Bell Telephone Laboratories reported radiation comin ...
, Walsh functions can help reduce the effects of electrical
crosstalk In electronics, crosstalk is any phenomenon by which a signal transmitted on one circuit or channel of a transmission system creates an undesired effect in another circuit or channel. Crosstalk is usually caused by undesired capacitive, induc ...
between antenna signals. They are also used in passive LCD panels as X and Y binary driving waveforms where the autocorrelation between X and Y can be made minimal for pixels that are off.


See also

*
Discrete Fourier transform In mathematics, the discrete Fourier transform (DFT) converts a finite sequence of equally-spaced samples of a function into a same-length sequence of equally-spaced samples of the discrete-time Fourier transform (DTFT), which is a complex- ...
* Fast Fourier transform *
Harmonic analysis Harmonic analysis is a branch of mathematics concerned with the representation of Function (mathematics), functions or signals as the Superposition principle, superposition of basic waves, and the study of and generalization of the notions of Fo ...
*
Orthogonal functions In mathematics, orthogonal functions belong to a function space that is a vector space equipped with a bilinear form. When the function space has an interval as the domain, the bilinear form may be the integral of the product of functions over the ...
*
Walsh matrix In mathematics, a Walsh matrix is a specific square matrix of dimensions 2, where ''n'' is some particular natural number. The entries of the matrix are either +1 or −1 and its rows as well as columns are orthogonal, i.e. dot product i ...
*
Parity function In Boolean algebra, a parity function is a Boolean function whose value is one if and only if the input vector has an odd number of ones. The parity function of two inputs is also known as the XOR function. The parity function is notable for its ...


Notes


References

* * * * * * * * * * *


External links

* * * * {{Authority control Special functions